A Data-Aware Resource Broker for Data Grids
نویسندگان
چکیده
The success of grid computing depends on the existence of grid middleware that provides core services such as security, data management, resource information, and resource brokering and scheduling. Current general-purpose grid resource brokers deal only with computation requirements of applications, which is a limitation for data grids that enable processing of large scientific data sets. In this paper, a new dataaware resource brokering scheme, which factors both computational and data transfer requirements into its cost models, has been implemented and tested. The experiments reported in this paper clearly demonstrate that both factors should be considered in order to efficiently schedule data intensive tasks.
منابع مشابه
DICE e - Science Paper 1 Production Storage Resource Broker Data Grids
International data grids are now being built that support joint management of shared collections. An emerging strategy is to build multiple independent data grids, each managed by the local institution. The data grids are then federated to enable controlled sharing of files. We examine the management issues associated with maintaining federations of production data grids, including management o...
متن کاملMySRB & SRB: Components of a Data Grid
Data Grids are becoming increasingly important in scientific communities for sharing large data collections and for archiving and disseminating them in a digital library framework. The Storage Resource Broker provides transparent virtualized middleware for sharing data across distributed, heterogeneous data resources separated by different administrative and security domains. The MySRB is a web...
متن کاملImplementing Preservation Services over the Storage Resource Broker
Many international institutions and organizations responsible for managing large distributed collections of scientific, cultural and educational resources are establishing data grids that employ the San Diego Supercomputer Centre’s Storage Resource Broker (SRB) for managing their collections. Over time, maintaining access to the resources stored within SRB data grids will become increasingly di...
متن کاملUser requirements from the academic science community drove the implementation of data management technology, and the evolution of data grid capabilities from simple data management to information and knowledge management. The SRB and iRODS systems
The Data Intensive Computing Environments group has been developing data grid technology for twenty years. Two generations of technology were created, the Storage Resource Broker SRB (1994-2006) and the integrated Rule Oriented Data System iRODS (2004-2016). Both products represented pioneering technology in distributed data management and were widely applied by communities interested in not on...
متن کامل